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Abstract 

A catadioptric sensor induces a projection between a given object surface and an image 
plane. The prescribed projection problem is the problem of finding a catadioptric sensor that 
realizes a given projection. Here we present a functional that describes the image error induced 
by a given mirror when compared with a given projection. This expression can be minimized to 
find solutions to the prescribed projection problem. We present an example of this approach, by 
finding the optimum spherical mirror that serves as a passenger side mirror on a motor vehicle. 
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1 Introduction 



A catadioptric sensor generally consists of a camera pointed at a convex mirror. Catadioptric 
sensors of this type tend to have large fields of view, and hence their most common application 
is panoramic imaging. 

We will assume a simple model of the dioptric component, known as the pinhole model, 
which realizes the perspective projection. A limiting case of perspective projection is the 
orthographic projection, in which the rays that impinge upon the image plane are parallel. 
Such systems can be thought of as very narrow field perspective devices. 

Almost all work on catadioptric sensor design refers to sensors employing rotationally sym- 
metric mirrors, since these mirrors are the simplest to make and to mathematically model. The 
design of such mirrors reduces to solving an ordinary differential equation. 

The earliest example of a camera employing a mirror is due to A.S. Wolcott |15j and appears 
in the 1840 patent "Method of taking Likenesses by Means of a Concave Reflector and Plates so 
Prepared as that Luminous or other Rays with act Thereon." Remarkably, this device, which 
is designed for use with a daguerreotype plate, appears just a few years after the invention of 
photography. Since this patent, an enormous number of catadioptric cameras and projection 
devices have appeared, many of which are documented on the webpage , which is a historical 
resource on catadioptric sensor design created by the author. The first use of differential methods 
for the design of a mirror shape in a catadioptric sensor appears in the 1945 patent of Bcnford 
0. Other works that make use of differential methods include @], 00, [El, H3 , M- 
|1()|.|7|. Early applications to robotics include ^B] and ^3- A heuristic approach to image 
error is discussed in [T4] , 



2 Statement of the Prescribed Projection Problem 

In this section we state the prescribed projection problem, which is our fundamental problem 
of interest. Suppose one is given a fixed surface, S, in i? 3 , which we will call the object 
surface and a camera with image plane I, also fixed in R 3 . A given mirrored surface M 
induces a transformation Tm from some subset of I to S by following a ray (determined by the 
camera model) from a point q G / until it intersects the mirror at a point r. The ray is then 
reflected according to the usual law that the angle of incidence is equal the angle of reflection 
and intersects S at a point s. We then define 1a/ (q) = s . 
The prescribed projection problem for systems containing a single mirror is: 



Given G : I — ► 5, find M such that Tm = G. If no such M exists, then find M such that 
Tm is a good approximation to G. 



We will refer to G(q) as the target point. If an exact solution to the problem exists, then there 
are several ways to calculate it. Otherwise, there are numerous ways to formulate and solve the 
approximation problem. 

Notice that for a given M, with q, r and s as above, that the vector + yfrrfy is normal 
to M at r. This suggests a method of constructing a vector field W on i? 3 that will be normal 
to the solution: for each r G R 3 lying on a ray that enters the camera, define 

W(r)= q(r) ' r + G ^~ T (1) 
U |q(r)-rr|G(q(r))-r| [) 

where q(r) is the projection of r to I along the ray. We refer to this construction as the vector 
field method. Thus our problem is solved if we find a surface whose gradient is parallel to W. 
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3 Image Error and Projection Error 



A disadvantage of some of previous approaches to the problem is that they do not directly 
address the error in the image, i.e., the goal should be to minimize the distortion error in the 
resulting image. 

Given the notation that Tm is the transformation induced from the image plane to the object 
surface by the mirror M, then the goal is to find a solution to the equations 



T M (x) = G(x) (2) 

which is a system of partial differential equations that is generally inconsistent (an example of 
such a system is equations and |5J) . We then define the projection error induced by a mirror 

M as 

Pe(M) = I -^/jT M (x)- G (x)|^ ) (3) 

where U is the domain in the image plane over which the surface M is a graph. For example, 
in the approach to the blindspot problem described below, the projection error of a mirror 
described as a graph x = f(y, z) over [—1, 1] x [1, 1] is 



i /_;/_; ( (i - / - 2 f )(! ' +fc> + ^-'--) 2+ (-^ + — )*^< < 4 » 

where the prescribed transformation G is [xo, y, z] i— > [ay, —k, az]. (Here we are not taking the 
surface to be at infinity.) For example, if a = 1 then the mirror x = y makes the projection 
error functional 0. 

The projection error compares the image formed by projecting the domain U from the image 
plane to the object surface, whereas we are interested in the error formed by the projection from 
the object plane to the image plane via M. Thus we define the image error as the quantity 

UM) = J \G~\y) T M \y)\ 2 dA, (5) 

where V is the image of U under Tm- In this form it is not possible to directly minimize the 
image error because computing T M X is intractable. While it is possible to compute the projection 
for a generic M, it does not appear possible to compute T7f because the structure of the bundle 
of rays from the object plane to M is unknown until M is given. Nevertheless, performing a 
change of variables on the integral JSJ) by taking y = Tm(x) gives 



I e = I \G-\y)-T M ^dA = J v | G - 1( T M(X) ) -x|Vet( rf T M (x))|^ 

(6) 

This functional is amenable to numerical minimization. One great advantage of this func- 
tional is that any solution M derived by any one of the previous methods may be improved by 
minimizing I e with M as an initial condition. 



4 An application to design 

The main purpose of deriving an expression for the image error is so that it can be minimized over 
some appropriate family of surfaces and hence provide an answer to the prescribed projection 
problem. 
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In PJ, the authors consider the equations for a sideview mirror. It is shown that the projection 
Tm induced by a surface x — f(y, z) viewed orthographically along the x-axis (the image plane 
is x = xq) to the plane y = —k, k > is 

[x ,y,z] -> [gi(y,z), -k,g 2 (y,z)], (7) 

where 

(i-f y 2 -L 2 )(y + k) 
ffi = - ttt^ + f(y,z) (8) 

92 = t + z - (9) 

h 



The desired projection, G is 



[x ,j/,z] -> [ay, -fc,a*] (10) 



Since Tm and G are known, we may minimize the image error over some class of surfaces. 
Ideally one would perform this minimization over a large space, such as polynomials, trigono- 
metric functions, or spline functions. Here we answer the question "What is the best spherical 
sideview mirror ?" . 

We consider a spherical mirror which goes through the origin and with a center in the plane 
z = 0, which has the general form 

f(y, z) = -a+ Va 2 - z 2 - y 2 + 2yb. (11) 

Thus the parameters that are free for minimization are a and b. For this problem, if the 
required field of view is 45 degrees (this determines a and assuming that the image plane is a 
unit square of side length 2, the optimal result, (using a gradient dcsccndent algorithm) is 

a -2.83 (12) 



b ~ 2.38. (13) 
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